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(57) Abstract 



Managing interoperability of digital devices such as a digital video disc player and a digital television interconnected via a digital 
bus is provided- This interoperability is based on the IEEE 1394 serial bus for the physical and link layers and makes use of AV/C or CAL 
as the control language. This invention provides for transferring a DVD subpicture that has been transformed into a bit-mapped on-screen 
display (OSD) format via an asynchronous channel of the interconnecting serial bus. 
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DIGITAL BASEBAND INTFRFAPF P QR a DVT) PT AVFT? 

Field of the Invpnrinn 

This invention concerns a method for managing the interoperability of 
digital devices such as a digital video disc player and a digital 
television interconnected via a digital bus. More particularly, the 
invention involves a system for processing digital video disc (DVD) 
subpictures by a digital television. 

Background of thp I nvention 

Video signal processing systems that utilize storage media having 
digitally compressed video and audio information recorded thereon 
include, amongst other devices, a digital video disc player adapted to 
process information stored in accordance with the digital video disc 
(DVD) specification. The information on a DVD formatted disc is 
recorded as discrete packets of data, in accordance with the applicable 
video and audio data compression standards, wherein designated 
packets carry data associated with various data streams, such as 
alternative video angles, audio tracks, subpicture streams and 
navigation information. A video disc player reading a DVD formatted 
disc may be controlled to display certain packets of data and skip 
over others. A single disc may be authored to allow playback of 
multiple camera angles, story endings, scenes according to a ratings 
content, etc. DVD subpictures are used as the graphical user interface 
(GUI) for such features as providing the user the ability to select from 
one of several different videos on a disc. Using this capability, the 
DVD system can be used to prevent unauthorized access to 
information on a particular disc as well as seamlessly provide 
multiple variations of a video title in accordance with user commands. 
Current DVD players mix the decoded subpicture information with the 
decoded video into a single analog video signal for transport to a 
television. 

A device such as a DVD player may be coupled to other devices, such 
as a display device, a video/audio recording device, audio equipment 
and communicate with these other devices via a data bus. Such 
communication occurs in accordance with a bus protocol. Examples of 
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rap i ZafZ inClUde Consu nier Electronics Bus (CEBus) and the 

i t §h Performanc e Serial Bus. A bus protocol tvpicallv 
provides for communicating both control information and data 'For 
example, CEBus control information is communicated on a "control 
5 channel having a protocol defined in Electronics Industries 

Association (EIA) specification IS-60. On an IEEE 1394 serial bus 
control information is generally passed using the asvnchronous 
services of the serial bus. Control information for a particular 

,o pv^'iT ^ bG dGfined USing 3 P^^ing language such as for 
io example, Common Application Language (CAL) or AV/C 

Summary nf T he Invpnrjnn 

This invention resides, in part, in the inventor's recognition of the 
is below mentioned problems associated with processing the DVD 
subpictures and navigation control in the digital television. Today, 
digital video disc (DVD) players process digitallv compressed video 
and audio information stored in accordance with the digital video disc 
(DVD) specification. This processing includes the conversion of the 
20 compressed digital stream to a standard signal (e.g., an NTSC or PAL 
signal). A remote control device or the front panel of the DVD plaver 
is used to produce a "quasi-interactive" program. That is, in response 
to a user command, a DVD subpicture is generated and combined with 

5 s T° 8ram StrCam Pri ° r l ° conver *ng *e digital stream to 

25 an NTSC signal. The DVD subpicture may be thought of as a menu 
identifying available user initiated options. Navigation through the 
program is achieved in response to selection of one of these options. 
Thus navigation information may be thought of as logic that is 

30 S^r i* ?r t0 SeleCti ° n ° f ° ne of ^ available 0 P u °ns 
30 identified m the DVD subpicture. 

Video decoding could be performed in a digital apparatus, for 
example, a digital television (DTV) or digital set-top box, however, it 

,< expensive to *e subpicture data with the video in 

35 the DVD player prior to transport to the digital apparatus. For 
simplicity and convenience of comprehension, the remaining 
discussion of the present invention will encompass the utilization of a 
digital television although this invention is equally applicable for use 
with a digital set-top box. At present, DTVs do not support run- 
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length encoded format that is used for DVD subpictures. The advent 
of digital television receivers eliminates the burden of converting the 
digital stream produced in a digital video disc player to an NTSC 
signal, thereby creating a unique ability to harness the benefit of the 
digital signal by processing the digital stream within the digital 
television. However, the additional requirement of decoding DVD 
subpictures and interpreting DVD navigation information in the 
digital television would greatly increase the cost and complexity of 
the digital television. This invention also resides, in part, in providing 
an apparatus and method for solving the described problems. 

The present invention provides for receiving, in a digital television, bit- 
map digital data representative of a DVD subpicture and combining the 
bit-map digital data with a decoded content stream received from the 
DVD disc. Particularly, the present invention provides a digital video 
signal processing apparatus and method for receiving from a digital 
video disc player a program content stream representative of a 
programmed event; decoding the program content stream to generate a 
signal suitable for display; receiving from the digital video disc player 
digital data suitable for display associated with the program content 
stream; and combining the digital data received from the digital video 
disc player and the program content stream to produce a signal 
representative of a combined image suitable for display. The program 
content stream comprises data configured in a compressed format. 

Another aspect of the present invention provides for receiving 
subsequent displayable digital data representative of an updated portion 
of the previously received digital data; and updating the combined 
displayable image with the received subsequent displayable data to 
produce an updated combined displayable image. The step of updating 
being responsive to user input received by the digital video disc player. 

Yet another aspect of the present invention provides for a system for 
controlling a digital video disc player interconnected by a digital bus to a 
digital television. Particularly, the digital video disc player processes a 
program content stream of a digitally compressed format received from 
a digital video disc received in a digital video disc player to generate an 
audio/video program stream and a subpicture stream; transmits the 
audio/video program stream to the digital television via an isochronous 
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channel of the digital bus; processes the subpicture stream to generate 
displayable digital data (e.g., bit-map OSD); and transmits the displavable 
digital data to the digital television via an asynchronous channel of the 
digital bus. 

Brief Description of th P nr^^ f c 

The invention may be better understood by referring to the 
enclosed drawing in which: 

Figure 1 shows, in simplified block-diagram form, a typical 
digital video disc player. 

Figure 2 shows, in simplified schematic block-diagram form, a 
system illustrating the interoperability of the digital video disc player of 
Figure 1 employing the present invention. 

Figure 3 shows, in simplified schematic block-diagram form, an 
alternate embodiment of the system shown in Figure 2. 

In the drawings, reference numerals that are identical in different 
figures indicate features that are the same or similar. 

Detailed QpsrHption of th e Drawing s 

The use of IEEE 1394 serial bus has been suggested for many 
applications within a Home Network environment. It is being 
discussed within Video Electronics Standards Association (VESA) for 
use as a "whole home network." It is being built into the next 
generation PCs and will be used for many local peripherals including 
disc drives as well as digital audio/video consumer electronic devices 
such as digital televisions (DTVs) and digital video disc (DVD) players. 

IEEE- 13 94 is a high speed, low cost digital serial bus developed for 
use as a peripheral or back-plane bus. Some of the highlights of the 
bus include: dynamic node address assignments, data rates of 100, 
200, and 400 Mbits/sec, asynchronous and isochronous modes, fair 
bus arbitration, and consistency with ISO/IEC 13213. 
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Figure 1 is a block diagram showing the basic elements of a typical 
digital video disc (DVD) player 24. The construction and operation of 
these elements are known to one of ordinary skill in the art and will 
not be discussed in detail here. Disc player 24 comprises motor and 

5 pickup assembly 26 which, under the control of servo processor 29, 
spins the disc and reads the information stored thereon. Preamp 27 
and DVD data processing unit 28 translate the electrical pulses from 
motor and pickup assembly 26 into digital data that can be further 
processed by digital audio/ video decoder unit 30. DVD data 

10 processing unit 28 typically performs functions such as demodulation, 
error correction and descrambling of the raw data read from the disc 
so that the data is in a suitable format for decoder unit 30. Error 
correction may involve data processing such as that associated with a 
Reed Solomon algorithm. 

15 

Decoder unit 30 receives the demodulated, error corrected and 
descrambled data, processes the data, and provides the appropriate 
video and audio signals to a display unit, such as a NTSC television set. 
Particularly, decoder unit 30 comprises data stream demultiplexer 32 

20 which demultiplexes the data from data processing unit 28 into a 

plurality of separate data streams, including a video stream, an audio 
stream and a subpicture stream, and provides the data streams to 
their respective data decoders. Video decoder 3 1 receives the video 
stream and provides a video signal to mixer 33. Subpicture decoder 

25 34 receives the subpicture stream and provides data to on screen 
display (OSD) control 35 which provides OSD video signals to mixer 
33. The combined video signal from mixer 33 is provided to 
NTSC/PAL encoder 42 which provides a video signal that conforms to 
the appropriate video signal standard to a video display device, such 

30 as an NTSC television. Audio decoder 36 receives the audio streams 
from data stream demultiplexer 32 and provides the appropriate 
audio signals to an audio system. 

Microcontroller 40 controls the operation of digital video disc player 
35 24. Microcontroller 40 is coupled to user control device 37, which 
may comprise IR remote control devices, front panel buttons or the 
like, and translates data from user control device 37 to control the 
operation of the various elements of disc player 24 described above. 
Typically, microcontroller 40 is also configured to control various 
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SST ? h u 24 includin g> but not limited to, parental 

tock out, descrambling or decryption information and navigation data. 
Microcontroller 40 may be embodied in various forms, including, but 
not limited to, a dedicated integrated circuit, or a part of a 
decoder/controller unit. 



The combined video signal generated by mixer 33 may be forwarded 
to the digital television via an IEEE 1394 digital bus. Unfortunately 
die through-put of the decoded and uncompressed video signal may 
degrade system operation due to the band width requirement of 
transferring such a video signal via a IEEE 1394 digital bus for 
example, 30 frames/second X 720 horizontal pixels X 480 vertical 
pixels X 24 bits/pixel = 250 Mbits/second. The band width for 
present IEEE 1394 serial buses is typically limited to 200 
Mbits/second. Even with a 400 Mbit/second serial bus, after 
subtracting the band width necessary for overhead, transferring such 
decoded and uncompressed video signals would be difficult For 
comparison purposes, such a bandwidth correlates to about one-sixth 
the size of a decoded HDTV signal. As described in further detail 
below, the present invention resides in part in recognition of this 
problem, and in part, in identifying a solution thereto. 

Today's digital televisions provide many benefits for digital video 
processing. Figure 2 defines a system 100 for providing 
interoperability between DVD player 24 and digital television (DTV) 
50 via an IEEE 1394 serial bus 60. In such a system 100 
interoperability may be achieved by transferring the compressed 
MPEG stream from DVD player 24 to an MPEG decoder integral with 
DTV 50. Transferring DVD subpictures from DVD player 24 to a DTV 
50 can be achieved using one of several formats. For example, a 
subset of HTML without the navigation features mav be used to 
describe the OSD. Another possibility is to use a run-length-encoding 
format which is similar to the DVD subpicture format. However, the 
Pre ^ 6 w embodiment involve * transferring the actual information in 
^£^ il " maP f0rmaL F ° r ^Pte' ^ 8 bit/pixel, full screen, 
640X480 OSD can be transferred in about 100 msecs utilizing 1096 of 

the bandwidth of the 200 Mbit/sec IEEE 1394 serial bus 
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Converting DVD subpictures to an OSD bit-map format and 
transferring the OSD bit-map subpicture directly from DVD player 24 
to DTV 50 via an asynchronous channel of serial bus 60, for example, 
utilizing a "Pull" method, is described below. DVD player 24 processes 
the digitally compressed video and audio information stored on the 
video disc thereby generating a digital stream in an MPEG-PS 
(program stream) format. In one embodiment of the present 
invention the MPEG-PS stream is first converted to an MPEG-TS 
(transport stream) format by PS to TS Converter 39. The MPEG-TS 
audio/video digital stream is transferred to DTV 50 utilizing an 
isochronous channel of IEEE 1394 serial bus 60. The OSD bit-map 
subpicture is not transferred as a composite compressed MPEG video 
stream but is transferred as a bit-mapped OSD where the OSD may be 
overlay ed in DTV 50 with the decoded MPEG audio/video stream 
prior to being displayed. 

Transferring compressed MPEG-TS data via the digital bus eliminates 
the throughput and processing problems. The digital television may 
contain an MPEG Audio/Video Decoder which will be utilized for 
decoding the MPEG-TS stream. The user will still directly interface 
with DVD player 24 utilizing the respective user control device 37 
(i.e., front panel or remote control). The responses of such user 
interaction is handled within DVD player 24 by decoding the MPEG 
sub-pictures and generating a bit-map subpicture OSD. The bit-map 
OSD may be transferred via an asynchronous channel of IEEE 1394 
serial bus 60 to the OSD buffer located in DTV 50. The bit-mapped 
image is overlayed, within the digital television, with the decoded 
video MPEG signal. The combined (or overlaid) signal is then 
displayed. 

Figure 3 shows an alternate embodiment of the present invention 
wherein the MPEG-PS stream is directly decoded by the MPEG 
decoder in the DTV. MPEG-PS streams require less processing power 
than MPEG-TS streams; thus broadcast decoders with sufficient packet 
buffers that utilize software for demultiplexing could be programmed 
to directly decode MPEG-PS streams. Thus, PS to TS Converter 39 is 
not required. The audio/video content stream in an MPEG-PS format 
is transferred over an isochronous channel of IEEE 1394 serial bus 60 
to an MPEG decoder in DTV 50. 
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To™ L b nT? f ° mat f ° r ttanSfer 0f DVD '""pictures allows (1, 
the DVD manufacturer to maintain the "look and feel" of the 

subpicmre, (2) for freedom in the generation of the subpicture and 

(3) for dynamic updates (i.e. partial screen or even single pixel 

updates are possible). Compared to compressed represents, the 

bit-map representation requires less processing time to displav 

because delaying such bit-mapped subpictures requires minimal 

mMT r „^ 0n H and H maniPUlati0n - Desc ™ approaches, such as 
ZZ£T ^vantage of being difficult to specify and upgrade 
for typical consumer products. 

To simplify the transfer of bit-mapped subpictures, a "Pull" method is 
preferably utilized. With this method, the bulk of the NnJ^fc 
transferred from DVD player 24 to DTV 50 using the asynchronous^ 
channel of the IEEE 1394 digital bus. DTV 50 reads the bit-map data 
from the memory of the peripheral device (i.e., DVD player) bv 
making use of at least one block read transaction of IEEE 139 4 ' The 
display device is informed of the location and size of the bit-map data 
via a trigger command which is sent from DVD player 24 to DTV 50 
when the DVD player 24 is ready to begin transferring dal 

DW%o -Th T, f"" v™**** ^pictures from DVD plaver 24 to 
u^..^ ^ aSynchronous method which primarily 

uses IEEE 1394 asynchronous write transactions initiated bv DVD 

^™ r ,ZTs f\ bit " maP ^ tato D ™ 50 - «) an isochronous 
import method for broadcasting the bit-map data over one of the 
sochronous channels provided by IEEE 1394, (3) an asynchronous 

b^nT? ^T"** Ae sub P' ctures and (4) alternated, the 
bit-map data could be provided via a 8 VSB-T(trelUs) or 16 VSB RF 
remodulated channel. 

Once the subpicture is ready for transfer, DVD 24 sends a trigger 
message to DTV SO. A unique trigger message 22 may be utilized for 

21 u TrtT e - itiatl0n ° f 3 bl ° Ck tt " nsfcr usuai 'y <*curs through 
the use of a trigger message from DVD 24 to DTV 50. A queue may be 

implemented in the displav device so rhar rri„„„, 

... ' • uc ™- e so m at trigger messages are 

processed in the same order in which they are received. 
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After a trigger message is received from the target, the OSD module in 
DTV 50 requests memory accesses (i.e., asynchronous reads) starting 
at the memory location specified in the trigger message. The display 
device reads all of the information associated with the subpicture and 
begins to construct the actual bit-map image. At the same time, it 
informs DVD 24 that the block has been read so that DVD 24 may free 
up any memory it had allocated to the transfer of this data block. 
This subpicture is then displayed. DTVs 50 OSD controller (not 
shown) uses this data to construct the OSD and mix it with the 
decoded MPEG video in DTV 50. 

The time required for transfer of bit-map data through the digital bus 
may be calculated as follows. For example all the data required for a 
640x480 OSD with 4 bits/pixel requires 1,228,800 bits. All of this 
data can be transferred in about 150 ms assuming a 100 Mb/sec bus, 
a packet payload of 512 Bytes and assuming that we can transmit one 
packet each 500|xsec. This time decreases even further when one 
takes into account that no OSD takes up this much space. Using only a 
quarter (typical) of the entire screen results in roughly 40 ms 
transfer time. Small updates can be on the order of a few 
milliseconds. 

Application Control lan^ia^ 

In order for a consumer electronic device to interact with other 
devices interconnected via a IEEE 1394 serial bus, a common set of 
commands must be defined. Three standard approaches for device 
modeling and control are CAL, AV/C and the approach adopted for the 
Universal Serial Bus (USB). 

The design of control languages is based on the assumption that all 
consumer electronic products have a hierarchical structure of common 
parts or functions. CAL and AV/C are control languages that 
distinguish between logical and physical entities. For example, a 
television (i.e M a physical entity) may have a number of functional 
components (i.e., logical entities) such as a tuner, audio amplifier, etc. 
Such control languages provide two main functions: Resource 
allocation and Control. Resource allocation is concerned with 
requesting, using and releasing Generic Network resources. Messages 
and control are transported by the FCP as defined in IEC-61883 and 
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discussed above. For example. CAL has adopted an object base 
methodology for its command syntax. An object contains and has sole 

mn S c T I 6 ' nUmber ° f intemal Vaiues known as ins ^e variables 
(IV). Each object keeps an internal list of methods. A method is an 
action that an object takes as a result of receiving a message. When a 
method is invoked, one or more IVs are usually updated. A message 
may include a method identifier followed bv zero or more 
parameters. When an object receives a method, it looks through its 
list of methods for one which matches the method identified in the 
message. If found, the method will be executed. The parameters 
supplied with the message determine the exact execution of the 
method. 



15 



20 



For a CAL implementation, all devices that are capable of displaving 
OSDs must implement the following OSD object. This object assumes 
Asynchronous PULL with trigger message approach. This object 
would be carried in the trigger message from DVD 24 to DTV 50 
Digital television 50 would then pull the menu by reading it from 
DVD's 24 bus mapped memory space. The response of this request 
will be used by DVD 24 as an indication that the display device has 
read these update blocks. 



25 



\_2__ ~QSD Update Tnsser Object 



OSD Update Trigger Object 



The 



I (16) Data Mention.- 



deviceT" i$ U5ed for triggering the OSD mechanism in display capable 



IV 
(61) 



b 
(62) 
C(43) 



K6C) 



R/W 
R 



R/W 



R/W 



Type 



Numeric 
Numeric 



Numeric 
Data ( ) 



Name 



size_of_block 

length_of 
-record 



current 
-index 



memorv 
-block 



Context Function 



size of "memory_biock" in bvtes 
(default value =10) 
length of current_record in 
bvtes (default value =10 ) 



current record block pointed to 
(default value = 0) 



In each record. 6 MSBs contain 
the offset and LSB contains the 
OSD_type, remaining 3 bvtes 
represent the length of OSD in 
bvtes. 



Although the exemplary embodiment is described with reference to a 
digital video apparatus adapted to read compressed video and audio 
data from a disc and to process the data in accordance with the DVD 
specification, it is to be understood that the present invention mav be 
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used in any video processing apparatus capable of processing digital 
video and audio information, wherein program related information 
included with the video and audio information can be used to 
selectively restrict the playback of certain video and audio 
5 information on the disc. 

While the invention has been described in detail with respect to 
numerous embodiments thereof, it will be apparent that upon a 
reading and understanding of the foregoing, numerous alterations to 

10 the described embodiment will occur to those skilled in the art and it 
is intended to include such alterations within the scope of the 
appended claims. For example, the invention has been described with 
respect to DVD players, however this invention is equally applicable 
to any digital device processing at least one stream of compressed 

is digital data. 
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Claims 

What is claimed: 

1. A digital video signal processing apparatus comprising: 

(a) means for receiving from a digital video disc player a 
program content stream representative of a programmed event, said 
program content stream including data in a compressed format; 

(b) means for decoding said program content stream to generate 
a video signal suitable for display; 

(c) means for receiving from said digital video disc player digital 
data suitable for display, said digital data being associated with said 
program content stream; and 

(d) means for combining said digital data received from said 
digital video disc player and said video signal to produce a signal 
representative of a combined image suitable for display. 

2. The digital video signal processing apparatus of claim 1 wherein 
said digital data is representative of a DVD subpicture associated with 
said program content stream. 

3. The digital video signal processing apparatus of claim 2 further 
comprising 

(a) means for receiving subsequent digital data suitable for 
display, said subsequent digital data being representative of an updated 
portion of said previously received digital data; and 

(b) means for updating said combined image with said received 
subsequent digital data to produce an updated combined image suitable 
for display, wherein said updating means is responsive to user input 
received by said digital video disc player. 

4. The digital video signal processing apparatus of claim 3 wherein 
said digital data is bit-mapped data. 
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5. In combination in a system for controlling a digital video disc 
player interconnected by a digital bus to a digital television, the digital 
video disc player performing the steps of: 

(a) processing a program content stream including data in a 
compressed format received from a digital video disc received in said 
digital video disc player to generate an audio/video program stream and 
a subpicture stream; 

(b) transmitting, via an isochronous channel of said digital bus to 
said digital television, said audio/video program stream; 

(c) processing said subpicture stream to generate digital data, 
said digital data being suitable for display; and 

(d) transmitting, via an asynchronous channel of said digital bus to 
said digital television, said digital data. 

6. The combination of Claim 5 further comprising the steps of: 

(a) receiving a user initiated command in response to said 
displayable digital data; and 

(b) generating an updated subpicture stream in response to said 
user initiated command. 

7. The combination of Claim 5 wherein said audio/video stream is 
configured in an MPEG program stream format. 

8. The combination of Claim 7 further comprising the step of: 
converting said audio/video stream from an MPEG program stream 

to an MPEG transport stream. 

9. A digital video signal processing apparatus perfonning the steps of: 

(a) receiving from a digital video disc player a program content 
stream representative of a programmed event, said program content 
stream including data in a compressed format; 

(b) decoding said program content stream to generate a video 
signal suitable for display; 

(c) receiving from said digital video disc player bit-map data 
representative of a subpicture associated with said program content 
stream, said bit-map data being suitable for display; and 

(d) combining said bit-map data received from said digital video 
disc player and said program content stream to produce a signal 
representative of a combined image suitable for display. 
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10. The digital video signal processing apparatus of Claim 9 further 
comprising the steps of: 

(a) receiving subsequent bit-map data representative of an 
updated portion of said previously received subpicture; and 

(b) updating, in response to a user initiated command received 
by said digital video disc player, said combined image with said received 
subsequent bit-map data to produce an updated combined image 
suitable for display. 6 

11. A digital video signal processing apparatus comprising- 

(a) means for receiving from a storage means a compressed 
digital data stream; 

(b) means for decoding said compressed digital data stream to 
generate a video signal suitable for display; 

(c) means for receiving from said storage means bit-map data 
associated with said compressed digital data stream; and 

(d) means for combining said bit-map data received and said 
video signal to produce a signal representative of a combined image 

20 suitable for display. 
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